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DETAILED ACTION 

This action is responsive to the application filed on 12/16/2003. All claims have been 
examined and are currently pending. 



Drawings 

1 . The drawings are objected to because they fail to provide labels for the blocks used in the 
block and flow diagrams in figures 1-8. Corrected drawing sheets in compliance with 37 CFR 
1.121(d) are required in reply to the Office action to avoid abandonment of the application. Any 
amended replacement drawing sheet should include all of the figures appearing on the immediate 
prior version of the sheet, even if only one figure is being amended. The figure or figure number 
of an amended drawing should not be labeled as "amended." If a drawing figure is to be 
canceled, the appropriate figure must be removed from the replacement sheet, and where 
necessary, the remaining figures must be renumbered and appropriate changes made to the brief 
description of the several views of the drawings for consistency. Additional replacement sheets 
may be necessary to show the renumbering of the remaining figures. Each drawing sheet 
submitted after the filing date of an application must be labeled in the top margin as either 
"Replacement Sheet" or "New Sheet" pursuant to 37 CFR 1.121(d). If the changes are not 
accepted by the examiner, the applicant will be notified and informed of any required corrective 
action in the next Office action. The objection to the drawings will not be held in abeyance. 



Application/Control Number: 10/582,849 
Art Unit: 2626 



Page 3 



Claim Rejections - 35 USC § 102 

The following is a quotation of the appropriate paragraphs of 35 U.S. C. 102 that form the 
basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a foreign country or in public use or on 
sale in this country, more than one year prior to the date of application for patent in the United States. 

2. Claims 18- 19, 21-22, 24- 27, 29-30, 32-34 are rejected under 35 U.S.C. 102(b) as being 
anticipated by CAMPBELL, "FOREIGN-LANGUAGE SPEECH SYNTHESIS", XP002285739, 
Proceedings of ESCA/COCOSD A Workshop on Speech Synthesis, pp. 1 77-180, (1998) 
(Applicant's admitted prior art- further referred to as Campbell). 

Regarding claims 18 and 26 Campbell teaches a method and system (where the method 
of Campbell is inherently tied to a system for implementation) for text-to-speech conversion of a 
text in a first language comprising sections in at least one second language {Intro para. 3: 
pronounce the foreign words that appear in a multi-lingual text), comprising the steps of: 
converting said sections in said second language into phonemes of said second language (2 
Multi;Lingual Text para 4: produce a phonetic rendering of each utterance); 
mapping at least part of said phonemes of said second language onto sets of phonemes of said 
first language (Intro para. 5: match the sounds of the target speech through the use of a mapping 
vector); 
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including said sets of phonemes of said first language resulting from said mapping in the stream 
of phonemes of said first language representative of said text to produce a resulting stream of 
phonemes; and generating a speech signal from said resulting stream of phonemes (3.1 Phone 
Mapping; Intro para. 3: pronounce the foreign words that appear in a multi-lingual 
text . . . synthesizing email or . . .pages ...), 

wherein said step of mapping comprises: carrying out similarity tests between each phoneme of 
said phonemes of said second language being mapped and a set of candidate mapping phonemes 
of said first language (Intro para. 5: match the sounds of the target speech through the use of a 
mapping vector); 

assigning respective scores to the results of said tests (3.2 scoring of every candidate phone); and 
mapping each said phoneme of said second language onto a set of mapping phonemes of said 
first language selected from said candidate mapping phonemes as a function of said scores. 

Regarding claims 19 and 27 Campbell teaches mapping said phoneme of said second 
language into a set of mapping phonemes of said first language selected from: a set of phonemes 
of said first language including three, two or one phonemes of said first language (Intro para. 5: 
match the sounds of the target speech through the use of a mapping vector; 3.1 phone Mapping; 
3.2 - where segments and vectors can include multiple phonemes), 

or an empty set, whereby no phoneme is included in said resulting stream for said 
phoneme in said second language. 



Regarding claims 21 and 29 Campbell teaches representing said phonemes of said second 
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language and said candidate mapping phonemes of said first language as phonetic category 
vectors, whereby a vector representative of phonetic categories of each said phoneme of said 
second language is subject to comparison with a set of phonetic category vectors representative 
of the phonetic categories of said candidate mapping phonemes in said first language (Intro para. 
5: match the sounds of the target speech through the use of a mapping vector; 3.2 para. 4-5). 

Regarding claims 22 and 30 Campbell teaches wherein said comparison is carried out on 
a category-to-category basis by allotting respective score values to said category-by-category 
comparisons, said respective score values being aggregated to generate said scores (3.2 para. 4-5 
comparing their acoustic similarities - where the acoustic similarities correspond to the 
categories; 3.2 scoring of every candidate phone). 

Regarding claims 24 and 32 Campbell teaches selecting said phonetic categories from the 
group of: (a) two basic categories of vowel and consonant; (b) a category diphthong; (c) vowel 
characteristics unstressed/stressed, non-syllabic, long, nasalized, rhoticized, or rounded; (d) 
vowel categories front, central, or back; (e) vowel categories close, close-close-mid, close-mid, 
mid, open-mid, open-open-mid, or open; (f) consonant mode categories plosive, nasal, trill, 
tapflap, fricative, lateral-fricative, approximant, lateral, or affricate; (g) consonant place 
categories bilabial, labiodental, dental, alveolar, postalveolar, retroflex, palatal, velar, uvular, 
pharyngeal, or glottal; and (h) other consonant categories voiced, long, syllabic, aspirated, 
unreleased, voiceless, or semiconsonant. 
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Where these are well known phonetic features/categories in the art (based on the 
International Phonetic Alphabet by the International Phonetic Association), and when using 
phonemes some of these features are inherently (and have to be) used. The known nature of 
these features is further shown in applicant's disclosure by the mention of the features based on 
the international standard (IP A) {Page 7 lines 25-26). 

Regarding claims 25 and 33 Campbell teaches 25. The method of claim 18, comprising 
the step of pronouncing said resulting stream of phonemes by means of a speaker voice of said 
first language (Abstract : rather than switch voices; Introduction para. 3: using the voice of the 
original speaker). 

Regarding claim 34 Campbell teaches A computer program product loadable in the 
memory of at least one computer and comprising software portions capable of performing the 
steps of the method of claim 18 (where based on the nature of the reference, this is inherently 
known. Further, the application of email and HTML further demonstrates the method being 
performed using such). 

Claim Rejections - 35 USC §103 

The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
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having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

3. Claims 23 and 31 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
CAMPBELL, "FOREIGN-LANGUAGE SPEECH SYNTHESIS", XP002285739, Proceedings of 
ESCA/COCOSD A Workshop on Speech Synthesis, pp. 1 77-180, (1998) (Applicant's admitted 
prior art- further referred to as Campbell). 

Regarding claims 23 and 3 1 Campbell teaches allotting differentiated weights to said 
score values in aggregating said respective score values to generate said scores. 

The claim merely mentions the use of weights. It would have been obvious to one of 
ordinary skill in the art to give weight to the scores to allow for the selection of the closest 
phoneme vector based on a particular characteristic that is deemed most important. 

4. Claims 20 and 28 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
CAMPBELL, "FOREIGN-LANGUAGE SPEECH SYNTHESIS", XP002285739, Proceedings of 
ESCA/COCOSD A Workshop on Speech Synthesis, pp. 177-180, (1998) (Applicant's admitted 
prior art- further referred to as Campbell) in view of Jensen, K., Riis, S., and Morten Pedersen. 
"Multilingual Text-To-Phoneme mapping for Speaker Independent name Dialing in Mobile 
Terminals." RTO-MP-066, Sept 2001 (further referred to as Jensen). 

Regarding claims 20 and 28 Campbell does not specifically teach wherein said step of 
mapping comprises: defining a threshold value for the results of said tests; and mapping onto 
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said empty set of phonemes of said first language any phoneme of said second language for 
which any of said scores fails to reach said threshold value. 

Jensen teaches multilingual text-to-phoneme mapping that incorporates a threshold {Page 
3 Col 1 para. 2: larger than the threshold...). It would have been obvious to one of ordinary 
skill in the art at the time of the invention to not include phonemes that are not closely related 
based on a threshold to avoid the use of an incorrect pronunciation which could lead to numerous 
results, such as the section being incomprehensible. 

Conclusion 

5. The prior art made of record and not relied upon is considered pertinent to applicant's 
disclosure. 

- Multilingual speech recognition system using text derived recognition models - Riis 
et al (US 7,043,431) 

- Text-to-speech apparatus and method for processing multiple languages - Oh (US 
6,141,642) 

Text-to-speech conversion system for interlocking with multimedia and a method for 
organizing input data of the same - Lee et al (US 6,088,673) 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to SHAUN ROBERTS whose telephone number is (571)270-7541. 
The examiner can normally be reached on Mon - Thur 7-4 est. 



Application/Control Number: 10/582,849 Page 9 

Art Unit: 2626 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, David Hudspeth can be reached on (571)272-7843. The fax phone number for the 
organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would 
like assistance from a USPTO Customer Service Representative or access to the automated 
information system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 

/S. R./ 

Examiner, Art Unit 2626 



/Talivaldis Ivars Smits/ 
Primary Examiner, Art Unit 2626 



8/28/2009 



